Web Survey Bibliography
The role of panelist engagement on survey data quality in online panels has been a subject of discussion and com-mendation by industry and academic leaders (see Baker et. al. 2010). While there are many indicators of data quality in on-line surveys such as item nonresponse (Rao and Gravelle 2008) and breakoffs (Peytchev 2009; Heerwegh and Loosveldt 2006), one in particular has gained some attention in recent times: survey completion time. Much of this attention is coming in light of the scrutiny facing online panels today on the issue of panelists participating in numerous surveys in short time periods that suggests their motive for maximizing returns (i.e. incentives) while minimizing survey effort. Termed colloquially as “Speeders,” survey respondents who complete a survey more rapidly compared to the norm are the target of investi-gation in this study. The data behind this study come from an online mobile phone usage survey sourced from several online sample vendors. In addition to computing an index of speeding, we analyze the relationship between speeding and other data quality measures in order to test the popular notion that speeders provide lower quality data than their non-speeding counterparts. Furthermore, we investigate the variation of the index score for speeding across different samples, taken as a whole or as a random subsample within each sample. Lastly, using a multivariate framework, we analyze the demographic predictors of speeding after controlling for sample source and respondents’ mobile phone service characteristics. In addition to presenting quantitative evidence of the effect of speeding on data quality, this article concludes with a call for further research on the role of speeding in online panel surveys and recommendations for future research.
Conference Homepage (abstract) / (presentation)
Web survey bibliography (4086)
- Survey Data Quality Provisions in Statistics Canada E-Questionnaire Solution: Retrospective and Perspectives...; 2011; Abiza, Y.
- Developing Electronic Questionnaire Guidelines: Issues and Challenges in a Changing Environment; 2011; Cote, A.-M., Kelly, P., Lawrence, D.
- Triton: a general tool for data collection and micro editing; 2011; Erikson, J.
- A Generalized System for Aided Development and Monitoring of Web Surveys; 2011; Torelli, R.
- Ethical issues in Internet research; 2011; Hoerger, M., Currell, C.
- Using survey data collection as a tool for improving the survey process; 2011; Biffignandi, S., Perani, G., Laureti, A.
- Essential methods for design based sample surveys; 2011; Pfeffermann, D., Rao, C. R.
- A picnic in the field; negotiating the presentation of the self in researcher/respondent relationships...; 2011; Parsons, J.
- The benefits and constraints of e-mail interviews and discussions as methods of accessing valid data; 2011; Roberts, An.
- Is There a Quick Fix for Open-ended Questions? A Comparison of Qualitative Analysis Techniques; 2011; Langer Tesfaye, C.
- The Impact of Open-Ended Questions: A Multivariate Study of Respondent Engagement; 2011; Gittelman, S. H.
- “You are Invited to Participate”: Challenges of Applying Mixed Survey Methods to Assess...; 2011; Chew, F.
- Literacy and Data Quality in Self-Administered Surveys; 2011; Smyth, J. D., Olson, K.
- Catch Them When You Can: Speeders and Their Role in Online Data Quality; 2011; Gutierrez, C., Wells, T., Rao, K., Kurzynski, D.
- Observed Differences in the Placement and Wording of Neutral Response Options in Web Surveys: An Experiment...; 2011; Walton, L., Cobb, C. L., DiSogra, C.
- Does mentioning "some people" and "other people" in a survey question increase the...; 2011; Yeager, D. S., Krosnick, J. A.
- Do not track gathers momentum; 2011; Stark, D.
- “Don’t know” the difference - An experimental comparison between Web and CATI; 2011; Schielicke, A.-M., Degen, M.
- Display resolution; 2011
- A Survey Stopping Rule Based on Weighting for Unit Nonresponse; 2011; Lewis, T.
- Classic Inspirations for Social Research Methodology in the time of Online Access Panels ; 2011; Jerabek, H.
- Five Things You Should Know About Mobile Data Collection; 2011; Pingitore, G.
- Mixed Methods - Analyzing Open-Ended Comments in a Quantitative Employee Survey; 2011; Lawton, L., Broege, N.
- Changing Survey Methods (Discussion); 2011; Lavrakas, P. J.
- Causes of survey incompletes: Why panelists say they abandon surveys; 2011; Henning, J.
- Canadian online panels: Similar or different?; 2011; Chan, P., Ambrose, D.
- Blend, balance, and stabilize respondent sources; 2011; Eggers, M., Drake, E.
- Beyond data stability: Rising above quality concerns; 2011
- Background - QSOAP; 2011
- Audience evolution: New technologies and the transformation of media audiences; 2011; Napoli, P. M.
- Assessing personality traits through response latencies using item response theory; 2011; Ranger, J., Ortner, T. M.
- American public opinion: Its origins, content, and impact (8th Edition); 2011; Erikson, R. S., Tedin, K. L.
- Clarifying Survey Questions; 2011; Redline, C. D.
- A new representative standard for online research: Conquering the challenge of the dirty little "...; 2011; Gittelman, S., Trimarchi, E., Fawson, B.
- 2011 Skills for Life Survey: Headline findings ; 2011
- The place for mobile research? Multi-mode studies of major cultural events; 2011; Conry, S., Atkinson, S.
- Facial imaging: The new face of online survey research; 2011; Gordon, A., McCallum, D., Sorci, M., Llewellyn, T.
- How far is too far: Traditional, flash and gamification interfaces, and implications for the future...; 2011; Puleston, J., Malinoff, B.
- The Evolution of Edits in the Canadian Census of Population Online Questionnaires; 2011; Laroche, D.
- Hrh remuneration: Comparing wage levels, ranking And dispersion of 16 occupations In the health workforce...; 2011; Tijdens, K., de Vries, D.
- Wages worldwide results and measurement issues from the multi-country. WageIndicator web-survey ; 2011; van Klaveren, M., Tijdens, K.
- Text string matching to measure occupations in web-surveys; 2011; Tijdens, K. G.
- Web-based rating scales: HTML 5 and other innovations; 2011; Funke, F.
- A Methodological Inference towards the Quantification of Technological Frames ; 2011; Cachia, E., Camilleri, P.
- International Economics, Labour markets and Web Surveys Qualities; 2011; Guzi, M., de Pedraza, P.
- On Affordances and Technological Intersubjectivity; 2011; Vatrapu, R.
- The optimal number of response options in internet panel surveys; 2011; Thorsdottir, F.
- Online Research @ GESIS; 2011; Kaczmirek, L., Lenzner, T.
- Building online communities; 2011; Mlačić, B., Milas, G., Mikloušić, I.
- Romanian financing opportunities for the action; 2011; Moga, L.